DISPLAY SYSTEM FOR PRODUCING A VIRTUAL IMAGE 
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John G. Amery 
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Field of the Invention 

This invention relates generally to visual display systems and methods and, more 
particularly, to a system for displaying virtual images. 

Background of the Invention 

Visual display systems are commonly used to simulate training environments where 
training through actual operations would be dangerous, expensive, or otherwise impractical. 
One common application for visual display systems is flight simulation and training systems. 
A typical flight simulation and training system requires visual "out the window" images 
simulating the terrain, landscape, cultural features, buildings, vehicles, and other aircraft in 
the simulated vicinity of the trainee. 

One form of conventional flight simulator includes the projection of images onto the 
inside of a large, spherically-shaped dome or partial dome structure. The images are 
displayed inside the domes using multiple video projectors and associated optical devices 
mounted inside the domes. These projectors and optics must be carefully positioned inside 
the domes in order to properly display the simulated images. 

Another conventional form of a flight simulator typically includes one or more video 
display screens onto which video images are projected by one or more projectors, such as 
cathode ray tubes. The video images may be projected onto the display screens from either 
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the front or the rear of the screens. An example of such a conventional flight simulator is the 
Visual Integrated Display System (VIDS), manufactured by The Boeing Company, the 
assignee of the current invention. The VIDS provides four rear-projected video screens 
positioned a few feet from the trainee for displaying simulated images in front of the trainee 
5 and up to three additional rear-projected display screens for displaying simulated images 
behind the trainee. 

Conventional simulators also usually include a control panel, a control stick, and a 
throttle for providing input to the visual display system in response to the displayed video 
images. The control panel and surrounding environment are often realistic simulations of the 
10 controls and displays present in the actual craft. Thus, the operator can simulate the 
movement of a vehicle and can respond to the environment as depicted by the visual display. 

One primary objective of simulators is to enhance and optimize the simulated images 
to present the operator with a high fidelity and realistic visual environment. Problems 
experienced by conventional simulators include diminished brightness and contrast, and a 
C? 15 low resolution of projected images. These problems arise in large part because of the 
capability of conventional video projectors, and the use of a relatively small number of video 
screens (necessitating that each video projector project a relatively large image). 
Additionally, conventional simulators generally provide a real image that is focused 
relatively close to the trainee's eyes, not at a far distance, thereby causing visual fatigue. 
JL 20 Another drawback to conventional flight simulators is the size of the projectors, display 
jh J screens, and associated electronics and optics. An improved simulator would have a reduced 

overall size, allowing the entire simulator to be located in a small room, thus reducing the 
cost of installing and operating the flight simulator. 
Pj U.S. Patent No. 6,152,739 (the '739 patent) issued to Amery et aL and assigned to the 

25 Boeing Company introduces a virtual mosaic display system that produces high quality 
virtual images using a plurality of displays with a corresponding plurality of Fresnel lenses. 
The '739 patent shows a pattern of adjacently located lenses and is hereby incorporated by 
reference. The cost of components and construction of the virtual mosaic display is 
reasonable for a corporate or military simulator application, but may be excessive as a 
30 personal virtual image system. 

Video/entertainment games are low cost systems. However, the games produce real 
images that don't give one the feel of flying in an actual environment. 

Therefore, there exists a need to produce a low cost, virtual image system. 
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Summary of the Invention 

The present invention is a visual display system and method for producing a display 
image perceived as a far- focused virtual image by an operator. The display system includes a 
video image generation and display system, and a lens. The video image generation and 
display system includes an image generator and a video display electrically connected to the 
image generator. The image generator generates a video signal. The video display displays 
the generated video image based on the generated video signal. The lens is positioned 
between the operator and the video display. 

In accordance with further aspects of the invention, the lens has an associated focal 
length designed such that the display image viewed through the lenses appears at a desired 
distance. 

In accordance with other aspects of the invention, the lens is oriented parallel to the 
video display and substantially perpendicular to a line extending from the operator's view 
point. 

In accordance with still further aspects of the invention, the lens allows the operator 
to perceive the displayed image as a far-focused virtual image. The positive lens is a Fresnel 
type lens. 

In accordance with yet other aspects of the invention, the video display includes a 
flat-panel display. 

Brief Description of the Drawings 

The preferred and alternative embodiments of the present invention are described in 
detail below with reference to the following drawings. 

FIGURE 1 is a block diagram showing components of one embodiment of the present 
invention; 

FIGURE 2 is a perspective diagram of the present invention; and 
FIGURE 3 is a top or side view of the present invention. 

Detailed Description of the Invention 

FIGURE 1 illustrates components of an image generation and display system 14 
according to the present invention. The system 14 includes an image generator 16 electrically 
coupled to a video display 18 and a database 20. The video display 18 may be, for example, a 
low cost flat panel display, such as a conventional liquid crystal display (LCD) having a back 
fluorescent light source as commonly employed in laptop notebooks or other portable 
computers. Examples of other type of flat panel displays are field emission displays, plasma 
displays, and flat panel CRTs. The system 14 also includes a lens 22. 
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The image generator 16 generates a video signal based on an image application 
program (e.g., flight simulator, video game, etc.) stored on a hard disk or other non-volatile 
memory internal or external of the system 14 and executed by the image generator 16. The 
image generator 16 is suitably a conventional desktop personal computer or any other similar 
5 commercially available computing apparatus capable of generating video images. It will be 
appreciated that the image generation and display system 14 can include other components 
that are not shown, such as a power supply, interface cards, video accelerator cards, hard 
disks, and other conventional components. Because the aforementioned components are well 
known in the art, it will be appreciated that a detailed description of their construction and 
10 operation is not necessary for an understanding of the present invention. 

The database 20 includes a predefined three-dimensional structural database that is 
used by each of the image generators 16 to create the image that will be displayed on the 
video display 18 based on user interface inputs. The video display 18 is associated with a 
lens 22. The lens 22 is suitably an optical element that produces a substantially distortion- 
C| 15 free, collimated, virtual image. Example optical elements include a Fresnel lens, a 
*i holographic optical element (HOE), a diffraction pattern, any other type of optical element, 

|4 or a combination of any of the above. An example of a positive lens is a Fresnel-type lens 

having a planar surface. As is commonly known, a Fresnel lens is a thin replica of a Piano 
g\ lens cut into rings to obtain a flat profile. Each optical lens 22 is preferably mounted to a 

I 20 structural system (not shown) that also holds the display systems 14 and may hold the image 

Is;! 

y generation components. The optical lens 22 is preferably mounted parallel to the surface of 

£1 the video display 1 8 with its optical axis pointed toward a viewer's line of sight. 

J| 

H The focal length of the lens 22 is preferably optimized for the particular size of the 

uf simulator and the size of the video displays 18, and to accommodate the operator's 

25 anticipated head movement. Further, the focal length of the lens 22 is selected based on two 
distances: the distance from the pilot's viewing position to the lens 22 and the distance from 
the lens 22 to the video display 18. These two distances are then adjusted for apparent virtual 
image location based on desired view distance and field of view available to the viewer. 
Thus, the focal length of the lens 22 is designed such that the portion of the image viewed 
30 through the lens 22 is perceived to be at a predetermined distance. 

Preferably, the Fresnel lens has a profiled surface structure in the form of grooves 
extending with a circular symmetry relative to the optical axis of the lens 22, i.e., 
perpendicular to the surface of the lens 22. The preferred Fresnel type of lens used in the 
present invention may be formed on a suitable transparent material such as acrylic or glass, in 
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accordance with well known pressing and cutting operations. The lens 22 may be 
manufactured as one large lens and then machined into the proper size and shape. Reflexite® 
Display Optics produces positive lenses that are suitably used in the present invention. 

In another embodiment, the lens 22 is a Fresnel lens with color separation correction, 
i.e. an achromatic Fresnel lens. In one example, a circular diffraction pattern is added to the 
Fresnel lens opposite the traditional grooves. In another example, an HOE is added to the 
Fresnel lens. The HOE emulates the circular diffraction pattern. 

The image displayed on the video display 18 is viewed by the viewer through the 
optical lens 22. The video display 18 is arranged and positioned at a distance from the 
predetermined viewing position of the viewer such that a virtual image created. The virtual 
image is created by placing the optical element (lens 22) at a distance from the display 18 
equal to or less than the element's focal length. Thus, the image seen by the viewer through 
the lens 22 requires the viewer's eyes to slightly converge (or be parallel), allowing the 
viewer to perceive a far-focused or substantially collimated virtual image - not a close real 
image. Thus, the image is perceived to be at a greater distance from the viewer than the 
distance between the viewer and the video display 18. When a virtual image is created at 20 
feet or more from a human with typical eye separation, the eyes are widely converged at a far 
image and the eyes are focused at a far image. Thus, for a simulated distant virtual image no 
conflicting information is sent to the mind to confuse it. 

The optical lens 22 is preferably rectangular in shape or the shape of the real image 
(display 18). FIGURE 2 shows a perspective view of the system 14 and FIGURE 3 shows a 
side or top view of the system 14. The lens 22 is preferably arranged such that its surface is 
substantially perpendicular to the viewer's line of sight. The present invention involves a 
viewer that has some freedom of movement or head box movement. To allow for a sufficient 
head box size, the present invention allows the viewer to view only a part of the total image 
on the display 18. When the head is moved side to side or up and down, the viewer sees other 
parts of the real image. 

While the preferred embodiment of the invention has been illustrated and described, 
as noted above, many changes can be made without departing from the spirit and scope of the 
invention. Accordingly, the scope of the invention is not limited by the disclosure of the 
preferred embodiment. Instead, the invention should be determined entirely by reference to 
the claims that follow. 
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